Image handling apparatus, image processing system, image process controlling method, and image process controlling program product

ABSTRACT

An image handling apparatus is disclosed, including an operation panel, hardware resources, a transferring part, and an image generation controlling part. The transferring part transfers image handle information input at the input screen to an external apparatus. The image generation controlling part receives and parses image generation information for at least one of the hardware resources to execute an image generation based on the image handle information, from the external apparatus in response to an instruction of the image generation, so that at least one of the hardware resources executes the image generation.

CROSS REFERENCE TO RELATED APPLICATIONS

This is a Continuation Application of U.S. Ser. No. 14/867,663, filedSep. 28, 2015, which is a Continuation Application of U.S. Ser. No.14/335,231, filed Jul. 18, 2014, now U.S. Pat. No. 9,172,831 issued onOct. 27, 2015, which is a Continuation Application of U.S. Ser. No.14/035,718 filed Sep. 24, 2013, now U.S. Pat. No. 8,823,992 issued onSep. 2, 2014, which is Continuation Application of U.S. Ser. No.13/103,702, filed May 9, 2011, now U.S. Pat. No. 8,570,571 issued onOct. 29, 2013, which is a Continuation of U.S. Ser. No. 11/436,698,filed May 19, 2006, now U.S. Pat. No. 7,957,021 issued on Jun. 7, 2011,and is based on and claims priority to Japanese Patent Application No.2005-148830, filed May 20, 2005. The entire contents of each of theabove are incorporated herein by reference in their entirety.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention generally relates to an image handling apparatus,an image processing system, an image process controlling method, and animage process controlling program product, and more particularly to theimage handling apparatus including an operation panel and at least oneof an imaging part and a printing part, the image processing systemincluding the image handling apparatus, the image process controllingmethod, and the image process controlling program product.

2. Description of the Related Art

Recently, an image forming apparatus, such as a multi-functionalapparatus which realizes various functions of a printer, a copier, ascanner, and a facsimile in a single chassis, includes a CPU (CentralProcessing Unit) similar to a general computer although a memory and alike are strictly limited. Each of the various functions is controlledby an application.

In some of such image forming apparatuses, an API (Application ProgramInterface) is opened to implement applications, and it is possible tocustomize by implementing appropriate application for a usageenvironment of a user after shipping (for example, Japanese Laid-openPatent Application No. 2005-269619).

Moreover, in the image forming apparatus displays a screen at anoperation panel by using HTML (Hyper Text Markup Language) data (forexample, Japanese Laid-open Patent Applications No. 2000-125073 and No.2002-152458).

However, in order to implement a new application based on the APT whichis opened, it is required to be acquainted with the C language, theJava™ language, and the like, and it is not easy to master theseprogramming languages. In addition, the image forming apparatus isrequired to provide an execution environment for a new applicationdevelopment and to be developed.

Also, in a case of displaying the HTML data at the operation panel ofthe image forming apparatus by an application of an external server, itis effective to develop a screen since the application can be developedand managed at a server side. However, since the HTML data are basicallyused to display data, only displaying the HTML data at the operationpanel can not realize to control special hardware used to generate animage.

SUMMARY OF THE INVENTION

Embodiments of the present invention solve or reduce one or more of theabove problems.

In order to solve or reduce one or more of the above problems, as one ofembodiments, an image handling apparatus may include an operation paneldisplaying an input screen allowing to input image handle informationfor handling an image based on display control information received froman external apparatus capable of connecting through a network, andreceiving an instruction of an image generation; hardware resources forgenerating an image; a transferring part transferring the image handleinformation input at the input screen to the external apparatus; and animage generation controlling part receiving and parsing image generationinformation for at least one of the hardware resources to execute animage generation based on the image handle information, from theexternal apparatus in response to an instruction of the imagegeneration, so that at least one of the hardware resources executes theimage generation.

In the image handling apparatus, it is possible to provide an interfacecapable of controlling special hardware mounted in the image formingapparatus.

BRIEF DESCRIPTION OF THE DRAWINGS

In the following, embodiments of the present invention will be describedwith reference to the accompanying drawings.

FIG. 1 is a diagram showing a configuration of an image processingsystem according to an embodiment of the present invention;

FIG. 2 is a block diagram showing a software configuration of amulti-functional machine according to the embodiment of the presentinvention;

FIG. 3 is a diagram showing a hardware configuration of themulti-functional machine according to the embodiment of the presentinvention;

FIG. 4 is a diagram showing an example of an operation panel of themulti-functional machine according to the embodiment of the presentinvention;

FIG. 5 is a diagram showing a functional configuration of an MFP browseraccording to the embodiment of the present invention;

FIG. 6 is a sequence diagram for explaining a process procedure of ascan process according to the embodiment of the present invention;

FIG. 7 is a diagram showing a display example of a scan conditionsetting screen according to the embodiment of the present invention;

FIG. 8 is a diagram showing a display example of a resolution settingscreen according to the embodiment of the present invention;

FIG. 9 is a diagram showing a definition example of a script forchanging a color of an LED lump according to the embodiment of thepresent invention;

FIG. 10 is a diagram showing a conceptual configuration example of scanexecution instruction data according to the embodiment of the presentinvention;

FIG. 11 is a diagram showing a definition example of the script in thescan execution instruction data according to the embodiment of thepresent invention;

FIG. 12 is a diagram showing an example of format data embedding theimage data according to the embodiment of the present invention; and

FIG. 13 is a sequence diagram for explaining a process procedure indoScan ( ) according to the embodiment of the present invention.

DESCRIPTION OF THE PREFERRED EMBODIMENT

In the following, an embodiment of the present invention will bedescribed with reference to the accompanying drawings. FIG. 1 is adiagram showing a configuration of an image processing system accordingto the embodiment of the present invention. In FIG. 1, the imageprocessing system 1 includes a multi-functional machine 101, a Webserver 102, an ASP (Application Service Provider) server 103, and alike, each of which is connected to a network (any of a wired orwireless network) such as a LAN (Local Area Network), the Internet, anda like.

The multi-functional machine 101 is an image forming apparatus whichrealizes various functions such as a copier, a scanner, a printer, and alike in a single chassis, and is one example of an image handlingapparatus. The multi-functional machine 101 includes an operation paneland an MFP (Multi-Function Peripheral) browser as a Web browser fordisplaying an operation screen at the operation panel based on HTML(HyperText Markup Language) data.

The Web server 102 is a general computer implementing a function as aWeb server such as an httpd (hypertext transfer protocol daemon) and alike. The Web server 102 includes an image forming control application1021 as a Web application. In response to an HTTP request from the MFPbrowser in the multi-functional machine 101, the image forming controlapplication 1021 generates an HTML data used for an operation screenwhich is to be displayed at the operation panel of the multi-functionalmachine 101, and sends the HTML data to the MFP browser.

The ASP server 103 is a general computer implementing an imageprocessing application as an application for providing various servicesconcerning image data formed in the multi-functional machine 101. Forexample, the image processing application 1031 accumulates image datawhich is scanned by the multi-functional machine 101 and transferred tothe ASP server 103, and delivers the image data to an indicateddestination.

FIG. 2 is a block diagram showing a software configuration of themulti-functional machine according to the embodiment of the presentinvention. In FIG. 2, the multi-functional machine 101 includes hardwareresources 111, a software group 112, and a boot part 113.

The hardware resources 111 of the multi-functional machine 101 includesan imaging part 121, a printing part 122, and other hardware 123. Theimaging part 121 is hardware to scan an image (image data) from anoriginal sheet. The printing part 122 is hardware to print the image(image data) on a printing sheet.

The software group 112 of the multi-functional machine 101 includesvarious applications 131, and various platforms 132, which are programs.These programs are executed in parallel by a process unit on an OS(Operating System) such as UNIX™ and the like.

The application group 131 includes a copy application 141 which is anapplication for a copy, a printer application 142 which is anapplication for a printer, a scanner application 143 which is anapplication for a scanner, a facsimile application 144 which is anapplication for a facsimile, a network application 145 which is anapplication for a network file, an MFP browser 181, and a like.

The MFP browser 181 corresponds to the above-described MFP browser. TheMFP browser 181 obtains HTML data from the Web server 102 shown in FIG.1 through a libwww 136 which is a library for realizing a clientfunction in an HTTP communication, and displays the HTML data at anoperation panel. Moreover, the MFP browser 181 comprehends scripts(program written in a script language) described in the HTML data, andcontrols the hardware resources 111 of the multi-functional machine 101.That is, the MFP browser 181 can comprehend not only the script which ageneral Web browser can process, but also a script (for example, anexecution instruction of a scan and a like) which is enhanced to controlthe hardware resources 111 of the multi-functional machine 101. Thus, itis possible to made the multi-functional machine 101 execute an imageprocess.

It should be noted that the application 131 can be developed by using aspecial SDK (Software Development Kit). The application 131 developed byusing the SDK is called a SDK application. As the special SDK, “CSDK”for developing the application 131 by the C language, and “JSDK” fordeveloping the application 131 by the Java™ language are provided. Theapplication 131 developed by using the CSDK is called a “CSDKapplication”. In the multi-functional machine 101 shown in FIG. 2, aCSDK application 146 and a JSDK application 147 are included. Moreover,in the multi-functional machine 101, a JSDK platform 148 is included assoftware 112 for intermediating between the JSDK application 147 writtenin the Java™ language and other software 112 written in the C language.

In the embodiment, the MFP browser 181 is an application implemented asthe CSDK application.

The platforms 132 includes various control services 151, a systemresource manager 152, and various handlers 153. The control service 151includes a network control service (NCS) 161, a facsimile controlservice (FCS) 162, a delivery control service (DCS) 163, an enginecontrol service (ECS) 164, a memory control service (MCS) 165, anoperation panel control service (OCS) 166, a certification controlservice (CCS) 167, a user directory control service (UCS) 168, and asystem control service (SCS) 169. The handler 153 includes a facsimilecontrol unit handler (FCUH) 171, and an image memory handler (IMH) 172.

A process of the NCS 161 intermediates a network communication. Aprocess of the FCS 162 provides an API of a facsimile. A process of theDCS 163 conducts a control concerning a delivery process of documentsbeing accumulated. A process of the ECS 164 conducts a controlconcerning the imaging part 121 and the printing part 122. A process ofthe MCS 165 conducts a control concerning a memory and a hard diskdrive. A process of the OCS 166 conducts a display control and a likeconcerning the operation panel. A process of the CCS 167 conducts acontrol concerning an authentication process and a charging process. Aprocess of the UCS 168 conducts a control concerning a management ofuser information. A process of the SCS 169 conducts a control concerninga management of a system.

The software 112 for intermediating between the applications 131 and theplatforms 132 includes a virtual application service (VAS) 135. The VAS135 acts as a server process for applications 131 as a client, and alsoacts as a client process for the platforms 132 as a server. The VAS 135includes a wrapping function for camouflaging the platforms 132 in aview from the applications 131, and assimilates a version difference dueto a version up of the platforms 132.

First, the boot part 113 is activated when the multi-functional machine101 is turned on. After the boot part 113 is activated, the OS such asUNIX™ or a like is activated, and the applications 131 and the platforms132 are activated. These programs are stored in the hard disk drive anda memory card, are reproduced from the hard disk drive and the memorycard, and resides in a memory.

FIG. 3 is a diagram showing a hardware configuration of themulti-functional machine according to the embodiment of the presentinvention. The hardware resources 111 of the multi-functional machine101 include a controller 201, an operation panel 202, a facsimilecontrol unit (FCU) 203, the imaging part 121, and the printing part.

The controller 201 includes a CPU 211, an ASIC (Application SpecificIntegrated Circuit) 212, an NB (North Bridge) 221, an SB (South Bridge)222, an MEM-P 231, an MEM-C 232, an HDD (Hard Disk Drive) 233, a memorycard slot 234, an NIC (Network Interface Controller) 241, a USB(Universal Serial Bus) device 242, an IEEE 1394 device 243, and aCentronics device 244.

The CPU 211 is an IC (Integrated Circuit) for various informationprocesses. The ASIC 212 is an IC for various image processes. The NB 221is a north bridge of the controller 201. The SB 222 is a south bridge ofthe controller 201. The MEM-P 231 is a system memory of themulti-functional machine 101. The MEM-C 232 is a local memory of themulti-functional machine 101. The HDD 233 is storage of themulti-functional machine 101. The memory card slot 234 is a slot to seta memory card 235. The NIC 241 is a controller for a networkcommunication by a MAC (Media Access Control) address. The USB device242 is a connection terminal of a USB standard. The IEEE 1394 device 243is a connection terminal of an IEEE 1394 standard. The centronics device244 is a connection terminal in accordance with a centronicsspecification. The operation panel 202 is hardware (operating part) foran operator to input data to the multi-functional machine 101, and alsois hardware (displaying part) for an operator to obtain an output fromthe multi-functional machine 101.

Each of the applications 131 such as the MFP browser 181 and the like isrecorded in the memory card 235, the HDD 233, or the like, and realizesits function by being processed by the CPU 211.

FIG. 4 is a diagram showing an example of an operation panel of themulti-functional machine according to the embodiment of the presentinvention. In FIG. 4, the operation panel 202 includes a touch panel311, a ten key 312, a start button 313, a reset button 314, functionkeys 315, and an initial setting button 316. The touch panel 311 ishardware (touch operating part) to input data by a touch operation, andalso is hardware (screen displaying part) to obtain an output at ascreen display. The ten key 312 is hardware to input numbers by a key(button) operation. The start button 313 is hardware for a startoperation by a button operation. An LED (Light Emitting Diode) lump 317is provided to the start button 313. The LED lump 317 is a lump forinforming validity of execution start of an application selected by thefunction keys 315. The LED lump 317 is turned to be red if conditions tostart the application are not met, and the LED lump 317 is turned to begreen if the conditions are met. Accordingly, a user recognizes that theuser can press the start button to start the application when the LEDlump 317 is lighted. The reset button 314 is hardware for a resetoperation by the button operation. Applications (for example, the copyapplication 141, the printer application 142, and the scannerapplication 143) are assigned to the function keys 315. However, whenany one of the function keys 315 is pressed, an initial screen of anapplication being assigned to the one of the function keys 315 isdisplayed at a touch panel 311. The initial setting button 316 ishardware to display the initial setting screen by the button operation.

Next, the MFP browser 181 will be described in detail. FIG. 5 is adiagram showing a functional configuration of the MFP browser accordingto the embodiment of the present invention. In FIG. 5, the MFP browser181 includes an engine part 502, a script processing part 503, an imagelibrary 504, a file operating part 505, an image converting part 506, ascreen building part 507, an operation panel data generating part 508,an event processing part 509, and a like. It should be noted that HTMLdata 600 is HTML data transferred from the Web server 102.

The engine part 502 is a main part of the MFP browser 181. The enginepart 502 parses an HTML and Java™ Script (hereinafter, simply called“script”) in the HTML data 600, instructs the screen building part 507to build an operation screen defined by the HTML, and instructs thescript processing part 503 or the file operating part 505 to execute aprocess defined in scripts.

The script processing part 503 executes a process concerning an imageprocess in processes defined in the scripts in the HTML data 600. Theimage library 504 is a library which provides a function interface foran application unit such as a copy, a scan, or a print. For example, thescript processing part 503 realizes a function such as the copy, thescan, or the print by calling the image library 504.

The file operating part 505 conducts a file operation which occurs whenthe scripts are executed or is needed for a cache of the HTML data 600.

The image converting part 506 converts the image data into a displayableformat when the HTML data 600 includes image data.

The screen building part 507 generates layout information of theoperation screen after the engine part 502 parses the HTML.

The operation panel data generating part 508 converts the layoutinformation generated by the screen building part 507, into a dataformat or a control instruction which the OCS 166 can comprehend, andoutputs information as the data format or the control instruction to theOCS 166 after the layout information is converted. The OCS 166 displaysthe operation screen at the touch panel 311 of the operation panel 202based on the information provided from the operation panel datagenerating part 508. That is, since the layout information generated bythe screen building part 507 is based on a general format, the operationpanel data generating part 508 converts the layout information so as tobe suitable for the touch panel 311 of the operation panel 202 of themulti-functional machine 101.

The event processing part 509 detects events occurred by inputs withrespect to the HTML data or the like displayed at the touch panel 311and operations with respect to other buttons (the start button 313 andthe like) on the operation panel 202, and informs occurrences of theevents to the engine part 502 and the like.

In the following, a scan process will be described as one example ofprocesses conducted by the image processing system 1. The scan processincludes various processes from a start of scanning an original sheet toa deliver of image data generated by scanning the original sheet.

FIG. 6 is a sequence diagram for explaining a process procedure of thescan process according to the embodiment of the present invention.

When the multi-functional machine 101 is turned on and activated and theMFP browser 181 is activated, the engine part 502 of the MFP browser 181sends an HTTP request concerning an URL of the initial screen, which isdefined beforehand, to the Web server 102 through the libwww 136 (S101).

The image forming control application 102 of the Web server 102 repliesto the MFP browser 181 with HTML data corresponding to the URL indicatedin the HTTP request (S102). In general, the initial screen may be alogin screen or a screen for selecting an application. In this case, asan example, the HTML data for displaying a scan condition setting screen(hereinafter, called “scan condition setting page”) are sent back to theMFP browser 181. Accordingly, the MFP browser 181 parses a definition inthe HTML for the scan condition setting page, and displays the scancondition setting screen at the touch panel 311.

FIG. 7 is a diagram showing a display example of the scan conditionsetting screen according to the embodiment of the present invention. InFIG. 7, the scan condition setting screen 601 displays a resolutionbutton 6011, a sheet type button 6012, a sheet size button 6013, adensity button 6014, a compression method button 6015, a destinationbutton 6016, and a like, each of which is a button for displaying ascreen to set a condition. In detail, in the scan condition settingpage, each of buttons 6011 through 6016 is associated with a URL as alink of the HTML data for setting a condition corresponding to thebutton.

For example, when the resolution button 6011 is pressed (touched)(S103), the MFP browser 1021 sends an HTTP request indicating an URLlinked to the resolution button 6011, to the Web server 102 (S104). Theimage forming control application 1021 generates HTML data fordisplaying a resolution setting screen (hereinafter, called “resolutionsetting page”) based on the URL, and replies to the MFP browser 181 withthe resolution setting page (S105). The MFP browser 181 parses adefinition of the resolution setting page, and displays the resolutionsetting screen at the touch panel 311.

FIG. 8 is a diagram showing a display example of the resolution settingscreen according to the embodiment of the present invention. As shown inFIG. 8, the resolution setting screen 602 displays a button for eachresolution. The resolution setting page defines an operation when the OKbutton 6021 is pressed. Accordingly, when one of resolutions is selectedat the resolution setting screen 602 and the OK button 6021 is pressed(S106), the MFP browser 181 sends a POST message informing theresolution selected by the user based on the definition in theresolution setting page, to the Web server 102 (S107).

When the POST message is received, the image forming control application1021 stores and maintains information indicating the resolution includedin the POST message in a memory of the Web server 102, and replies tothe MFP browser 181 with the scan condition setting page (S108).Accordingly, the display screen at the touch panel 311 goes back to thescan condition setting screen 601 (FIG. 7), again.

In the following, the user operates the scan condition setting screen601 to display setting screens for other conditions in the same manneras a case of setting the resolution. Data exchanges between the MFPbrowser 181 and the Web server 102 are conducted similar to the case ofsetting the resolution. By conducting several setting operations, forexample, the sheet type (black-and-white binary), the sheet size (A4),the density (high density), the compression method (MF), the destination(electronic mail address of a receiver), and the like are posted to theWeb server 102. The sheet type (black-and-white binary), the sheet size(A4), the density (high density), the compression method (MF), thedestination (electronic mail address of a receiver), and the like aremaintained in the memory by the image forming control application 1021(S109, S110, S112, and S113). That is, in this embodiment, the scancondition is not stored in the multi-functional machine 101 but isstored and maintained in the Web server 102. The multi-functionalmachine 101 simply executes a process in accordance with the HTML datasent from the Web server 102. Thus, the multi-functional machine 101 hasno concern with meanings of information to be displayed by the HTMLdata. As described above, the multi-functional machine 101 can be simplyimplemented. For a embedded device having a strict limitation of amemory capacity, this implementation method is a significantlyeffective.

The image forming control application 1021 comprehends a button pressedand the scan condition selected by the user by using the informationposted from the multi-functional machine 101 (MFP browser 181) ifnecessary. Thus, in response to a value selected for a certaincondition, the image forming control application 1021 can dynamicallychange contents of the setting screens for other conditions. Forexample, in a case in that color is selected as the sheet type, acompression method for binary data such as MH (Modified Huffman) or MMR(Modified MR) does not have meanings. Accordingly, in this case, theimage control application 1021 generates a compression method selectingpage to make selections of MH and MMR to be gray displays.

Moreover, it is possible to provide the HTML data to display the settingscreen suitable for a performance of the multi-functional machine 101.

When the image forming control application 1021 determines in responseto the scan condition successively sent from the MFP browser 181 thatleast necessary information to be set for a scan execution is collected,the image forming control application 1021 sends HTML data includingcontrol information allowing the user to press the start button 313 ofthe operation panel 202 of the multi-functional machine 101 to the MFPbrowser 181 (S114). In detail, the HTML data includes a definition ofthe script for changing a color of the LED lump 317 of the operationpanel 202 from red to green.

FIG. 9 is a diagram showing a definition example of the script forchanging the color of the LED lump according to the embodiment of thepresent invention. In script 603 shown in FIG. 9,“System.LocalCGI.Setting.StartKeyDisable=1” is an instruction to changethe color of the LED lump 317.

For example, in the HTML data including script 603, it is assumed thatthe script 603 is executed when the HTML data are loaded to the MFPbrowser 181 (occurrence of onLoad event). In this case, the engine part502 of the MFP browser 181 parses the script 603 and outputs a changeinstruction of the color of the LED lump 317 to the OCS 166 (S115). TheOCS 166 changes the color of the LED lump 317 to green.

It can be implemented so that the user is allowed to press the startbutton 313 (the LED lump 317 is changed from red to green) for a certainusage environment of the user even if no setting is made at the scancondition setting screen after the login. In the embodiment, a case isdescribed in that a scan can not be started until each condition is setand a destination is set.

When the LED lump 317 turns to green, the user recognizes that the usercan start a scan operation, and presses the start button 313 (S116). Apress event of the start button 313 is informed to the MFP browser 181.In response to the press event, the MFP browser 181 sends the HTTPrequest which requests data (hereinafter, called “scan executioninstruction data”) defining contents of a scan execution instruction(S117). The image forming control application 1021 generates the scanexecution instruction data (S118), and sends the scan executioninstruction data to the MFP browser 181 (S119).

The scan execution instruction data will be described. FIG. 10 is adiagram showing a conceptual configuration example of the scan executioninstruction data according to the embodiment of the present invention.In FIG. 10, the scan execution instruction data 604 are data of the HTMLformat similar to other HTML data, and includes a script 6041, settinginformation 6042, an image embedded area 6043, and a like.

The script 6041 defines the contents of the scan execution instruction.The setting information 6042 is used to handle image data obtained by ascan, and is a set of values of the scan conditions set through the scancondition setting screen in detail. For example, each condition isdistinguished by a tag and a value is described. The image embedded area6043 is an area to relate information (setting information 6042) forhandling the image data to the image data. For example, the image datamay be embedded in the image embedded area 6043. A pointer (locationinformation) of the image data is set and the image data is stored asanother file. In this case, a relationship for a correspondence betweenthe pointer and the image data may be managed in a format such as atable which is indicated by the URL (described later). In thisembodiment, a case of embedding the image data in the image embeddedarea 6043 will be described as one example. At this point, since thereis no image data, a start tag and an end tag indicating the imageembedded area 6043 are simply written.

FIG. 11 is a diagram showing a definition example of the script in thescan execution instruction data according to the embodiment of thepresent invention. In a script 6041 shown in FIG. 11, a description 6041b (“System.LocalCGI.doScan(<URL>, “Post”)”) is a scan execution function(hereinafter, called “doScan( )”), and the doScan( ) is defined andimplemented in the engine part 502 or the like. In the doScan( ), a scanexecution process and a deliver process of the scan image are defined.On the other hand, a description 6041 a is a definition so that the scancondition indicated by the user can be referred in doScan( ). In FIG.11, only settings concerning the resolution are described and othersettings are omitted.

In the scan execution instruction data 604, format data 6044 is a partformed by the setting information 6042 and the image embedded area 6043.The format data 6044 will be described later.

For example, it is assumed that it is defined in that the script 6041 isexecuted when the scan execution instruction data 604 is loaded to theMFP browser (at occurrence of onLoad event). In this case, the enginepart 02 of the MFP browser 181 calls doScan( ) by parsing the script6041, and executes the process defined in doScan( ). That is, by callingdoScan( ), the multi-functional machine 101 executes a scan, and imagedata obtained by the scan is transferred to an URL (for example, theimage processing application 1031 of the ASP server 103) indicated as anargument of doScan( ) (S120 and S121). The URL indicated by the argumentof doScan( ) may be determined in the Web server 102. Alternatively, adestination is set as a part of the scan condition can be used as theURL.

When the image data is transferred, the format data 6044 is used. Thatis, the MFP browser 181 extracts the format data 6044 from the scanexecution instruction data 604, and attaches (embeds) the image dataobtained by the scan between a start tag and an end tag within the imageembedded area 6043. Then, the MFP browser 181 transfers the format data6044 embedding the image data to the image processing application 1031.

FIG. 12 is a diagram showing an example of the format data embedding theimage data according to the embodiment of the present invention. In FIG.12, parts that are the same as those shown in FIG. 10 are given the samereference numbers.

In FIG. 12, the image data is embedded in the format data 6044 for eachpage of original sheets. In the step S121, the format data 6044 beingformed as described above is transferred to the image processingapplication 1031.

When the image processing apparatus 1031 receives the format data 6044,the image processing apparatus 1031 executes a process corresponding tothe format data 6044. For example, the image data is delivered to adestination indicated in the format data 6044. The format data 6044 alsoincludes the image data and the scan condition. Accordingly, the imageprocessing application 1031 can obtain the scan condition of the imagedata, and can deliver the image data after a further image process (forexample, a conversion of the resolution or a like) is conducted based onthe scan condition.

There are various formats required as transmission information of theimage data depending on servers (the ASP server 103 in the embodiment ofthe present invention). One format requires transferring metainformation in accordance with an XML (eXtensible Markup Language)format, and another format requires transferring information inaccordance with an MIME (Multipurpose Internet Mail Extension) format.The format data 6044 provides a mechanism corresponding to a formatcondition in general. That is, the format data 6044 is generatedcorresponding to a server being the destination beforehand, and storesthe format data 6044 in the Web server 102. Accordingly, themulti-functional machine 101 simply embeds the image data into theformat data 6044 downloaded from the Web server 102 and transfers theformat data 6044, without concerning a format possible for thedestination to process and a usage at the destination.

FIG. 12 shows a case of transferring the image data for a plurality ofpages at once. Alternatively, for example, in a case of changing thescan condition for each sheet, processes following the step S102 may berepeated for each sheet.

Next, the process conducted by doScan( ) will be described in detail.FIG. 13 is a sequence diagram for explaining a process procedure indoScan ( ) according to the embodiment of the present invention.

When the engine part 502 detects a call of doScan( ) in the script 6041in the scan execution instruction data 604, the engine part 502 conductsthe scan execution instruction by calling a function of the scriptprocessing part 503 (S201). As an argument of the function, the scancondition set in the description 6041 a shown in FIG. 11 is indicated.The script processing part 503 conducts the scan execution instructionby calling a function of the image library 504 (S202). The scancondition is indicated in an argument of the function.

The image library 504 calls the SCS 169 and has the SCS 169 check aready state (usable state or not) of the imaging part 121 which is ascanner engine (S203). When it is confirmed that the imaging part 121can be usable, the image library 504 requests the MCS 165 to acquire amemory (page memory) necessary to start a scan (S204). When the pagememory is acquired, the image library 504 calls the OCS 166 and has theOCS 166 display a message “Scanning” at the touch panel 311 (S205). Thatis, instead of being based on the HTML data obtained from the Web server102, the message “Scanning” is displayed in accordance with a controlinstruction, which is occurred within the multi-functional machine 101during a series of process steps for executing the scan. In the samemanner, an error and a scan end are displayed. A error display and ascan end display will be described later.

Subsequently, the image library 504 requires the ECS 164 to generate andexecute a scan job in accordance with the scan condition indicated bydoScan( ) (S206). The ECS 164 generates the scan job and outputs thecontrol instruction for executing the scan job to the imaging part 121(S207). In response to the control instruction from ECS 164, the imagingpart 121 executes a scan of an original sheet (S208). The image dataobtained by the scan are stored in the page memory acquired by the MCS165. Every time one page is scanned, a scan end notice is sent to theECS 164 (S209). The ECS 164 receives the scan end notice for each page,compressed the image data stored in the page memory, and storescompressed image data in the HDD 233 (S210).

In a case in that a jam (JAM) or a like occurs during the scan, anoccurrence of the jam is informed to the ECS 164 (S211). Moreover, theoccurrence of the jam is informed from the ECS 164 to the image library504 (S212). In this case, the image library 504 makes the OCS 166display the error at the touch panel 313 (S213). After the error isreleased, a popup display or a like for a stop or a restart of the scanis also controlled by the image library 504. The scan is stopped whenthe stop of the scan is instructed, and the scan is resumed when therestart of the scan is instructed.

When the ECS 164 receives the scan end for all pages, the ECS 164informs a job end notice indicating that the scan completed, to theimage library 504 (S214). The image library 504 calls the OCS 166 andhas the OCS 155 display a message “Scan End” at the touch panel 311(S215). Moreover, the image library 504 informs a scan end to the scriptprocessing part 503 (S216). The script processing part 503 informs thescan end to the engine part 502 (S217).

When the scan completed, the engine part 502 acquires the image datastored in the HDD 233 through the file operating part 505 (S218, S219,and S220). The image data acquired from the HDD 233 is embedded into theformat data 6044 (S211). Subsequently, the engine part 502 transfers theformat data 6044 embedding the image data to the URL indicated as theargument of doScan( ) (S222).

As seen from the above, after the scan execution instruction data 604 isreceived, a communication with the Web server 102 is not conducted,displays to the touch panel 311 such as “Scanning”, the error display,“Scan End”, and the like are conducted based on a control in themulti-functional machine 101. In the scan process (or the printprocess), a page to be resumed after the error is released generallydepends on a machine type, and also depends on a single side/double sidesheet, a single side/double side print, a presence of a finisher, and alike. A process becomes complicate if the error display, the popupdisplay of the stop or the restart, and the like are conducted based onthe HTML data acquired by the Web server 102. Accordingly, it iseffective to process these displays within the multi-functional machine101. Since these processes depending on the machine type and the likeare covered up by the multi-functional machine 101, logic, the HTMLdata, or the like provided from the Web server 102 can be applied incommon in different machine types.

The HTTP request concerning the URL of the initial screen is sent notonly when the MFP browser 181 is activated but also when a systemauto-clear function and an application auto-clear function areactivated. Since in the multi-functional machine 101, a plurality ofapplications are operated in parallel, there is the system auto-clearfunction in which if a user uses a specific application (for example,the scanner application 143) and leaves the specific application alone,the screen displayed at the touch panel 311 goes back to the initialscreen (in general, for the copy application 141, and changeable) of anapplication, which is automatically and initially displayed at a certaintime after power is turned on. In addition, it is concerned that theuser may step away from the multi-functional machine 101 in a middle ofusing the application, and the application auto-clear function isimplemented in which the screen displayed at the touch panel 311automatically goes back to the initial screen of the application when acertain time lapses. Accordingly, in a short time after the scanexecution, the MFP browser 181 downloads the scan condition setting pageby the application auto-clear function or the system auto-clearfunction, and displays the scan condition setting screen at the touchpanel 313. Moreover, when any one of the function keys 315 of theoperation panel 202 is pressed, the MFP browser 181 starts to downloadthe HTML data for displaying the initial screen of the applicationcorresponding to a key being pressed.

In the above, the ASP server 103 is the destination to transfer theformat data 6044 to which the image data are attached. Alternatively,the destination can be a personal computer (PC) of a user or the Webserver 102. In a case in that the destination is the Web server 102, itis convenient to transfer the format data 6044 in a session establishedbetween the MFP browser 181 and the Web server 102. However, since thescan process requires a certain time and the display at the touch panel313 during the scan execution is controlled in the multi-functionalmachine 101 as described above, the communication with the Web server102 is not always needed. Accordingly, it is concerned that the sessionbetween the image forming control application 1021 of the Web server 102and the MFP browser 181 may be time-out.

In order to prevent this time-out, the MFP browser 181 may send a dummyHTTP request to the Web server 102 periodically. Alternatively, afterthe scan execution instruction data 604 is received, the MFP browser 181may send an HTTP request for stopping a timer at a side of the Webserver 102, so as to stop clocking for a time-out of the session at theWeb server 102 during the scan. In this case, the MFP browser 181 maysends an HTTP request for resuming the timer before or after the formatdata 604 is transferred.

As described above, in the multi-functional machine 101 according to theembodiment of the present invention, the MFP browser 181 comprehendsdisplay information described in an HTML file and a script forcontrolling functions using specific hardware for the multi-functionalmachine 101 such as the scanner and the like. Accordingly, bydescriptions in the HTML data as text data, it is possible to easilycustomize the multi-functional machine 101 and also possible to controlthe specific hardware for generating an image even if a screen isdisplayed at an operation panel by the HTML data. In addition, since theHTML data are generated or managed by the Web server 102, it is possibleto customize a plurality of the multi-functional machines 101simultaneously by simply making a change at the side of the Web server102.

Moreover, the MFP browser 181 can conduct a process in accordance withthe HTML data downloaded from the Web server 102, and is not required tounderstand meanings of the display information based on the HTML data.Accordingly, it is possible to realize wealthy versatility and flexiblyprovide various solutions corresponding to a user environment.

Furthermore, the multi-functional machine 101 is not required to handlethe image data formed by scanning the original sheet, and simply embedsthe image data into the format data 6044 downloaded from the Web server102. In this point, versatility is realized.

In the embodiment of the present invention, the HTML data are downloadedfrom the Web server 102. The HTML data may be stored in the HDD 233 ofthe multi-function machine 101. The MFP browser 181 may control themulti-functional machine 101 based on the HTML data stored in themulti-functional machine 101. By this configuration, it is possible tosatisfy the user needs which do not wish to install the Web server 102.In this case, the MFP browser 181 and a Web server program are operatedby separate threads which communicate with each other by a loop backport of a local address (127.0.0.1).

Moreover, in this embodiment of the preset invention, the scan processis described. Alternatively, for example, the MFP browser 181 may beconfigured to conduct an execution control of a print, a FAXtransmission, or a copy based on a script such as doPrint( ), doFAX( ),doCopy( ), and a like, so that it is possible to easily customize forthe print, the FAX transmission, or the copy, by descriptions of theHTML data as the text data. Thus, even if a display at the operationpanel is conducted by the HTML data, it is possible to control specialhardware for forming an image.

The present invention is not limited to the specifically disclosedembodiments, and variations and modifications may be made withoutdeparting from the scope of the present invention.

What is claimed is:
 1. An image handling apparatus, comprising: anoperation panel displaying one or more input screens, including a webbrowser, allowing to input image handle information including one ormore scan settings for handling an image, the one or more input screenis displayed based on HTML data received from a web application of anexternal web server capable of connecting through a network, andreceiving a user instruction of an image generation from the web browserdisplaying at least one of the input screens; hardware resourceincluding a scanner for generating an image; and processing circuitryconfigured to transmit a first message including a scan setting fromamong the one or more scan settings, in response to the input at the webbrowser displaying at least one of the input screens, to the webapplication transmit a second message to the web application in responseto receiving the user instruction of an image generation, receive imagegeneration information for the scanner to execute an image generationincluding the one or more scan settings, from the web application, inresponse to the transmitted second message, transmitted to the webapplication from the web browser included in the image handlingapparatus, and control the scanner to execute the image generation,wherein the first message including the scan setting is transmitted tothe web application in a plurality of times, in response to each inputof the scan setting on at least one of the input screens, and the imagegeneration information including the plurality of scan settings, istransmitted from the web application to control the scanner, in responseto the user instruction of the image generation on the image handlingapparatus.
 2. The image handling apparatus according to claim 1, furthercomprising: an Application Program Interface (API) configured to providean interface to receive, from the external web server, an instructionfor the scanner to generate the image, based on the image handleinformation including the plurality of setting data, in response to thetransmitted message, transmitted to the external web server from the webbrowser included in the image handling apparatus.
 3. The image handlingapparatus according to claim 2, wherein, when the interface receives theinstruction for the scanner to generate the image, the interfacereceives at least one setting data included in the image handleinformation.